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We generalize the scale- free network model of Barabasi and Albert [Science 286, 509 (1999)] by 
I proposing a class of stochastic models for scale-free interdependent networks in which interdependent 

nodes are not randomly connected but rather are connected via preferential attachment (PA). Each 
• network grows through the continuous addition of new nodes, and new nodes in each network attach 

' preferentially and simultaneously to (a) well-connected nodes within the same network and (b) well- 

connected nodes in other networks. We present analytic solutions for the power-law exponents as 
functions of the number of links both between networks and within networks. We show that a 
cross-clustering coefficient vs. size of network A'^ follows a power law. We illustrate the models using 
selected examples from the Internet and finance. 
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'" p^ ■ Network research is a topic of interest with many applications in physics. For example, in quantum chromodynamics, 

I network models have been used in calculating quark- hadron transition parameters [ij , and Bose- Einstein condensation 

O . has connections with network theory Scale- free behavior has been observed in a huge variety of different networks, 

^ ' ranging from the Internet to biological networks With few exceptions |15l-l22|. most network studies have 



^ . focused on single networks that neither interact with nor depend on other networks [9|. Recently it was noted j23| 
^ ■ that port and airport networks interact with each other and that the coupling between these networks is not random 
" ^ . but correlated. Our general assumption is that real-life scale-free networks are correlated rather than isolated, and 



J>V that preferential attachment (PA) and its variants |24l-l26] control not only the dynamics within a network but also 



i-C . the dynamics between different networks. In bank-insurance firm networks, for example, we expect large banks to be 
, ^-f more attractive to insurance firms than small banks. 



Recently, Ref. [27[ investigated the behavior of the Ising model on two connected Barabasi - Albert networks in which 
each node of the network has a spin, and Jab — Jba are the coupling constants between spins in different networks. 
^ . Here we emphasize scale-free interdependent network dynamics rather than the robustness of interacting networks 



isl 17-22|. We propose a class of stochastic models for scale- free interdependent networks in which interdependent 



QQ . nodes are not randomly connected but are the result of PA. In our approach PA controls not only the dynamics of 
p\| ' each network but also the interaction between different networks. First, we define a coupled Barabasi- Albert (BA) 
model I composed of two interdependent networks BAi and BA2 where the PA between different networks and within 

■ a network is identical. Second, we define a coupled BA model II where the PAs between different networks and 
Cn| . within a network are distinct. Third, we define a "network of networks" model. Finally, we present two examples of 

interdependent networks, from the Internet and from finance. 

There are many interdependent networks or "networks of networks" (NON) in real- world data [l^. For example, in 
physiology, the human body is an example of a NON system that includes the respiratory, nervous, and cardiovascular 
systems. 

■ As an example of a NON we consider the Internet: a network of routers or autonomous systems (AS) connected 
by links (28l , [29| . Using the fractal concept in which each part of a complex system is an approximate reduced-size 



copy of the whole — i.e., is "self-similar" — we analyze AS connections not for the entire world [28|, |29| but rather the 
Internet connections between three countries. Specifically, we study AS connections between the US, Germany, and 
the UK recorded over an 18-month period. For each of the three countries we study both total connectivity {k'^) and 
the number of links (k) within each country. 

In the following analyses, in order to estimate power-law exponent 7 for a power-law distributed variable k with 
P(fc) oc we apply two methods. In the Zipf ranking approach in which R denotes rank, one commonly applies 
the regression 

log(k) =a-C log(i?), (1) 
where C = 1/(7 — 1), which is strongly biased in small samples (30l - l32j |. In the first method, in order to overcome this 
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bias, we apply a recently-proposed regression method |32| 

log(R-l/2)==a-(7-l) log(fc). (2) 
In the second method we estimate the power-law exponent 7' using the equation 

7' = l + iV[E^ilog(fct/fc^in)]-\ (3) 

where k„un is the smallest value of kt for which the power-law behavior holds, and the sum runs only over those values 
of kt that exceed fcmin 3^, 31 [ . Equation ([3]) is equivalent to the well-known Hill estimator where the standard error 



on 7, which is derived from the width of the likelihood maximum, is cr = + 0{l/n). 

For the sake of simplicity. Fig. [T] shows the NON results of our study on network of routers for only two in- 
terdependent countries, the US and the UK. We find that 9685 cities in the US and 1170 cities in the UK are 
connected by routers. For each country we show (a) the number of links established within the country, (b) the 
total number of links established not only within the country but also with the coupled country, and (c) the cross 
links, e.g., the links established from the UK routers to the US routers, and vice versa. Note that no cross-links 
between UK and the US router networks implies no interdependency between the networks. We find that each 
Zipf plot of k in Eq. [T] exhibits an approximate power-law scaling. For each country we find that 7"^ obtained 
for total connectivity is smaller than 7 obtained for links within a single country — employing Eqs. ©-([SI) for the 
US we find 7^ = 2.24 ± 0.01 (7'^ = 2.17 ± 0.04) and 7 = 2.26 ± 0.01 (7' = 2.17 ± 0.04). For the UK we find 
7^ = 2.0 ± 0.01 (7'^ = 2.21 ± 0.11) and 7 = 2.06 ± 0.01 (7' = 2.20 ± 0.11). We note that similar results for the 
exponents of degree distributions do not imply that interdependency exists between two networks. To this end, for the 
cross-links which quantify the level of interdependency between countries (again, no interdependency, no cross- links) , 
we find for US-UK 7 = 2.04 ± 0.03 (7' = 1.98 ± 0.09) and for UK-US 7 = 2.39 ± 0.02 (7' = 2.54 ± 0.24). We also 
show the cross- link interdependent router connections between the UK and Germany, with 1170 cities in the UK 
and 1989 cities in the Germany. We find for Germany- UK 7 = 2.01 ± 0.03 (7' = 2.01 ± 0.15) and for UK-Germany 
7 = 2.51 ± 0.05 (7' — 2.20 ± 0.25). Note that the similar degree distributions shown in Fig. 1 never guarantee similar 
mechanisms of network generations or even other characteristics of networks such as community structures and degree 
assortativity [ssj . 

To quantify the level of interdependency between two networks, we next define the cross-clustering coefficient Cij 
for two scale-free interdependent networks, each with N nodes. Following the definition of the clustering coefficient 
for a single network [s^] , we define the cross-clustering coefficient to be 

c^j=^^ij/hkj, (4) 

where ki and kj are the number of neighbors that nodes i and j have within its own network, and the number 
of links between the nodes comprising ki and ki. For the previous example of the Internet considering, e.g., the 
two interdependent couples (UK-Germany), chosen because the network size for each country is comparable, we find 
(Cij) = 0.155. Note that for two independent BA networks, Cij is zero. 

For the sake of simplicity we first model a NON system with only two interdependent networks. In model I, each 
of the two interdependent networks BAi and BA2 begins with a small number (mg) of nodes. At each time step t, 
we create a new BAi node j with (i) mi(< mo) edges that link the new node j to mi already existing nodes in BAi, 
and with (ii) mi2 edges that link j to mi2 already existing nodes in BA2. We assume that nodes in BAi and BA2 
linked to j are chosen based on a version of preferential attachment — the probability 11 that a new node j in BAi is 
connected to node i in BAi depends on the total number of links of node i with the already existing BAi and BA2 
nodes (total connectivity). Similarly, the same probability 11 controls whether a new node j in BAi is connected to 
node i' in BA2. 

We define the growth of the BA2 network similarly. At each time step t we add to the BA2 network a new node j' 
with m2(< mo) edges that link j' preferentially to m2 different nodes already present in BA2 and with m2i links that 
link j' preferentially to m2i already existing nodes in BAi. To reduce the number of parameters we set m2i — mi2- 
Note that if m2i = 0, while mi2 ^ 0, then due to m2i — each node in BAi has an equal number of links (mi2) to 
nodes in BA2, which is unlikely in real- world networks. After t time steps, the four parameters of model I — mi, m2, 
mi2, and m2i — lead to an interdependent network system with t + mo nodes in both BAi and BA2. BAi has the 
average degree (k) = 2mi -I- mi2 -I- m2i and BA2 has (k) = 2m2 -I- mi2 -|- m2i. We perform numerical simulations in 
which m2i = mi2. We then calculate the probability P{k) that a node in BAi has k edges either with BAi or BA2 
nodes. We set mi — m2 ~ 3, and vary mi2 = mi2. 

Figure [5] shows that, when m2i = 1, the Zipf plot of k exhibits a power law for varying values of mi2. With increasing 
1^12, C of the Zipf plot decreases (7 of P{k) increases), and the 7 exponent for BA2 decreases. When mi2 = 0, BAi 



3 



and BA2 become decoupled and yield (7 = 3), which is characteristic of the BA model. Thus the power-law exponent 
7 of P{k) is a function of the number of links mi, m2, and mi2{m2i) and, due to interdependencies, 7 can change 
substantially for different networks. 

Next, for model I we present analytic solutions for the power-law exponent 7 of P{k) as a function of the number of 
links both between and within networks. We apply the continuum approach introduced in Refs. which calculates 

the time dependence of the degree of a given node i, e.g., for BAi. kf^ is the total number of edges between i in BAi 
and other nodes in BAi — ki i — and between i and nodes in BA2 — fei i, 



h,i = ^1,1 + fc2i,j- (5) 

The probability that a new node j created in BAi will link to an already existing node i in BAi depends on the 
probability of this process, n(A:^j). Approximating fc^^ with a continuous real variable [9j], the rate at which kj^^ 
changes we expect to be proportional to n(/c^j) where 

dkl, , ^ ,^,,T ^ {mi+m2i)kl^ 

—- — = (rrii + m2i)mK, A = ■ . (6) 

dt ^ ' ^ 2mit + mi2t + m2it ^ ^ 

^From the denominator in the last expression we note that each endpoint of an mi edge is a node in BAi because 
mi edges are established between nodes in BAi. This is in contrast to m2i(mi2) edges where one end is linked to 
a node in BAi and the other to a node in BA2. The initial condition is that every new node i must have a degree 
^1 ii^i) = "^1 + "^12, since it connects to mi nodes in BAi and mi2 in BA2. From Eq. (|6|), we obtain 

= {mi+mi2){t/tif\ where 
2mi + mi2 + m2i 

Note that in the limiting case mi2 = m2i = the networks decouple with /? = 1/2, as in the BA model [1, Q. Other 
choices for /3 in single networks are proposed in different models |24ri26 | . 
The probability that a node i has a degree kf^{ti) smaller than k"^ is [1, 0| 



P[kl,{t) <k^]=P 



(mi +mi2)^/^H ' 



(8) 



Assuming that new nodes are entered homogeneously in time, the distribution of U values is P{ti) — l/(mo + t). 

Entering this expression into Eq. we obtain P [ti > (fcT)vii ) — 1 ^ (kT)^J^ilt+mo) ' ^^'^ degree distribution 

P{k^) of BAi 

^^ ^ dPjki. < k^) ^ (mi+mi2)^/^^t 
^ ' dkT (fcr)i//3i+i(t + wo)/3i' 

where, asymptotically, for t ^ 00 (networks with an infinite number of nodes), the above equation yields 

P(fc^) oc (fc'^)-^\ where 7i = ^ + 1, (10) 

Pi 

with Pi defined as in Eq. ((T]). Similar to Eq. ([5]), fcjj is the total number of links for a node i in BA2, which is the 
total number of edges between B A2 node i and other nodes in both B Ai and B A2 , and satisfies the dynamic equation 

^ = (m2 -fmi2)n(fc|; J = 2irt+tr^'t+mlif Following Eqs. dH])-®, the degree distribution P{k) in the BA2 network, 
72, and (32 is similar to that in Eqs. ^ and (|T0|) in which 1 is replaced by 2 and vice versa. 

Unlike the pure BA model, in which /3 = 1/2 0, , in the coupled BA model we find that the power-law exponent 
of the degree distribution depends on the number of edges within each network, mi(m2), and on the number of edges 
between the interdependent networks mi2(m2i). Also, in agreement with Fig. 1, when m2i — 0, for each mi2, /3i < 0.5 
implies 71 > 3 for P(fc), whereas P{k) for BA2 has 71 < 3. 

In addition to the degree distribution for the total number of links kj of Eq. ([7]), we next provide an analytic result 
for the degree distribution for the number of links between nodes within a BAi network. Following Eqs. ([5]) and (|6]), we 

obtain %i = 2m^t+L^2tXm^^t ■ Entering Eq. (0) into the previous equation, we obtain ki^,{t) = "17+^"'"^ (^)^' + 
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™^m^+m™^^^ . Following Eqs. (|8l)~([9]), the degree distribution P{k) for the total number of links between nodes within 
network BAi scales as P{k) cx for t ^ oo. Similarly, we calculate the degree distribution P{k) for the total 

number of links between different networks and again obtain P{k) oc k''^^ where fc2i.i(i) — (^f-^ + 

"^^^^+m2i^^^ • Thus the scaling exponent for P{k) is the same for links connecting nodes of different networks, k2i,i{t), 
links within a given network, fci^i(t), and for the total number of links, k^ i{t). In practice, by testing this regularity 
we can determine whether a given pair of interdependent networks follows model I. 

Model I has two interesting limits, (i) when mi2 = m2i = , Pi = h = 1/2, as in the pure BA model, and (ii) 
when mi2 oo nodes of BAi establish many more connections with BA2 than with other nodes in BAi. This implies 
that /?! — !> 0, as in Eq. ([7]), and /32 ^ 1, which yields exponents 71 ^> 00 (the Gaussian limit), as in Eq. pUj) . and 
72 — > 2 (the Zipf law). 

We further exemplify the utility of model I using two networks from Yahoo Finance for 2011. Figure [3] shows 
4,544 US firms listed on the NYSE and Nasdaq representing network BAi, and 15,636 mutual funds representing 
network BA2. Note that firms comprising BAi and mutual funds comprising BA2 present only a partial picture of 
the complete financial network. Clearly, one may extend this analysis by including additional networks such as hedge 
funds and pension funds. For each firm i of BAi we show the total number of holders, i.e., the total number of 
institutions holding shares (including links from institutional owners such as pension funds, banks, mutual funds, and 
hedge funds, but also other firms linked to i), kf^. Thus because mutual funds comprising BA2 hold shares in BAi, 
interdependency between the two networks is established. Figure [3] shows the exponents of Eqs. Q-© for US firms: 
7 = 2.73 ± 0.01 (7' = 3.42 ± 0.17). For each mutual fund i of BA2 we show the total number of holdings, which 
includes firms of BAi and also pension funds and other institutions not included in our study. We show the exponents 
of Eqs. ©-dSl) for mutual funds: 7 = 2.23 ± 0.002 (7' = 2.31 ± 0.09). Figure [3] shows the plot fc^, vs. rank between 
rank 20 and 2000. Figure [3] also shows kf^ vs. rank for US banks, which represent only a small fraction of the total 
number of US firms, where 7 = 2.17 ± 0.02 (7' — 2.39 ± 0.31). We note that we can replicate these diverse values for 
71 and 72 using model I. 

Next we study the scaling of the cross-clustering coefficient of Eq. (|4]) for two scale-free interdependent networks, 
each with N nodes, as a function of system size. We study the average of Cy versus N, (C) versus N. To give context 
to (C): in a friendship network (C) reflects to what extent an i-friend from city A and another i-friend from city 
B know each other. Figure 2] fixes (fc) = 16, and varies rni, m2, and mi2 = m2i in order to numerically determine 
that (C) vs. N follows a power law with an average slope 0.71 ± 0.02, a value close to 0.75, which is also obtained 
numerically for the global cluster coefficient for a single BA network [9|. As mi2 = m2i increases, the intercept of 
(C) vs. N also increases. Note that for two independent BA networks (C) is zero for all N. We also study two 
interdependent Erdos-Renyi (ER) networks, A and B, each of size N, where the probability of all links, both between 
and within networks, is p. First we find numerically that p = 0.5 • (fc) / {N — 1) is needed in order to reproduce a given 
(k) (note that p — {k)/{N — 1) corresponds to a single ER network). We next find that the cross-clustering coefficient 
(C) vs. N also follows a power law with slope —1, the same slope as found for the clustering coefficient vs. N in 
a single ER model joj. Figure |4] shows that the cross-clustering coefficient (C) for two interdependent BA models is 
stronger than (C) for two interdependent ER models. 

In order to define a new scale-free interdependent network model II in which we separately define the dynamics for 
growing links within a network and the dynamics for growing links between networks. In model II we create a new 
BAi node j with mi edges that link j to uii existing nodes in BAi, and with rni2 edges that link j to mi2 existing 
nodes in the BA2 network at each t. Similarly, we link a new node j' created in BA2 with 7712 edges to m2 existing 
nodes in BA2. We link new node j' to 77121 existing nodes in BAi. Links within networks, ki^i and fc2,i, are treated 
according to the ordinary scale-free BA model, i.e., using the continuum approach [9| ^^f- = TOin(fci_i) — 

^Q^'' = TO2lI(fc2^i) = ™2m2t • Thus liuks within a network only attract new links created within the same network. We 
similarly define that only links between networks can attract new links established between networks. The number 
of links of BAi node i with nodes in BA2, A:2i,i, and the number of links of BA2 node i with nodes in BAi,A;i2,i, 
satisfy = TO21 n(fc2i,j) = ""^^^^"'^ and = mi2 n(fci2,j) = """^^'^t'"' ■ Note that in edges ^21(^12), one 

end is linked to a node in BAi and the other to a node in BA2. Following Eqs. (|5))-([TU1). we find that the degree 
distribution P(fc) of the number of links between BAi and BA2 becomes P(k) oc fc^'*'^ where 73 = ]^ + 1 — 
This demonstrates that the power-law exponent 73 of P(fc) does not depend on parameters mi, m2, mi2, and m2i. 
In addition, P{k) follows a Zipf law. In practice, we can determine whether a pair of interdependent networks follows 
model II by testing this regularity. 

Models I and II, which we have used to study network pairs, can be generalized to 'N interdependent networks. For 
each pair (/, J) where / and J run from 1 to N ^ at each time step t we add a new node j to BA/ with mi{< mo) edges 
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to m/ already existing nodes in BA/ and m/j edges to to/j nodes already existing in BAj. Applying Eqs. ([S])-®, 
defined for a pair of networks, to the N networks case (the NON model), for kj^ — the total number of edges between a 

node i and other nodes in BAr, and between i and other nodes in BA/ — we obtain ^'t'"' = — !"1^n'^ ''^''"^'"Jn' ''' 1- 

Following Eqs. (|6l)-(fT0|). we find that the degree distribution P{k) of the number of links between BA/ and BAj 
becomes P{k) oc k~^^ where 75 = ^ + 1, and /35 = (to/ + T,j^^mjj)/{2mj + J^j^-^mij + T,j^^m,ji). 

Understanding the dynamics of interdependent networks — how different networks simultaneously evolve in time — is 
a necessary precondition to predicting the behavior of networks over time, and to discovering how quickly failures 
initiated in one network spread to other networks 35, 36j |. 
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FIG. 1: Level of interdependency between countries (no interdependency, no cross-links). Approximate power laws in the 
Internet obtained for the plot of number of links versus rank R in AS interdependent networks between different countries. 
We calculate the exponents of Eqs. ([2]) and ^ for the total number of links and the number of links established only within 
each country. For the US we obtain 7"^ = 2.24 ± 0.01 (7'^ = 2.17 ± 0.04) and 7 = 2.26 ± 0.01 (7' = 2.17 ± 0.04), and for the 
UK T-"^ = 2.00 ± 0.01 (7'^ = 2.21 ± 0.11) and 7 = 2.06 ± 0.01 (7' = 2.20 ± 0.11). For the cross-links, we obtain for US-UK 
7 = 2.04 ± 0.03 (7' = 1.98 ± 0.09) and for UK-US 7 = 2.39 ± 0.02 (7' = 2.54 ± 0.24). 




Rank R 



FIG. 2: Power law in the plot that a node has k edges, for a model I where mi = m2 = 3, m2i = 1 and mi2 is varying as 
1, 3, and 5. Each network, i.e. BAi and BA2, has 1,000 nodes. The Zipf slope ( is inverse of the cumulative distribution 
exponent 7, where C, = 1/(7 — 1). With increasing mi2, the Zipf slope ( for BAi is decreasing (7 increasing), whereas the Zipf 
slope for BA2 is increasing (7 decreasing). We show the case where mi2 — m2i = 0, — 0.5 (7 = 3), characteristic for the BA 
model. We show that P{k) is characterized by a power-law exponent that is a function of the number of links mi, m2, mi2 
and m2i. With increasing mi2, for BAi we have 71 = 2.776 ± 0.006 {^[ = 3.04 ± 0.20), 73 = 3.199 ± 0.007 (73 = 3.32 ± 0.23) 
and 75 = 3.56 ± 0.01 (75 = 3.25 ± 0.22). With increasing mi2, for BA2 we have 71 = 2.800 ± 0.006 ("y'l = 3.09 ± 0.20), 
73 = 2.541 ± 0.005 (73 = 2.66 ± 0.17) and 75 = 2.343 ± 0.005 (75 = 2.52 ± 0.15) 
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FIG. 3: Power laws in interdependent financial networks. Power law in the Zipf plot with exponent ( = (1 — 7) for total number 
of links versus rank R for 15, 636 mutual funds, 4, 544 US firms and separately for 384 US banks. For each firm i we calculate 
links from mutual funds and other firms to firm i. For each mutual funds i we calculate links from mutual fund i to other 
mutual funds. We obtain the following exponents: for firms 7 = 2.725 ± 0.008 (7' = 3.42 ± 0.17); for banks 7 = 2.17 ± 0.02 
(7' = 2.39 ± 0.31); for mutual funds 7 = 2.231 ± 0.002 (7' = 2.31 ± 0.09). 
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FIG. 4: Power law in the cross-clustering coefficient versus size of the two interdependent Barabasi-Albert (BA) model with 
{k) — 16, compared with the cross-clustering coefficient of a random graph, « A'^"^. With increasing mi2 = m2i the intercept 
of power law increases. 



